MAXIMAL SURFACE GROUP REPRESENTATIONS IN ISOMETRY 
GROUPS OF CLASSICAL HERMITIAN SYMMETRIC SPACES 
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Abstract. Higgs bundles and non-abclian Hodge theory provide holomorphic meth- 
ods with which to study the moduh spaces of surface group representations in a reduc- 
tive Lie group G. In this paper we survey the case in which G is the isometry group 
of a classical Hermitian symmetric space of non-compact type. Using Morse theory on 
the moduli spaces of Higgs bundles, we compute the number of connected components 
of the moduli space of representations with maximal Toledo invariant. 



1. Introduction 

Given a closed oriented surface, X, and a connected semisimple Lie group G, the 
moduli space of representations of vri(X) in G is defined as the set 

n{G) = Hom+(7ri(X),G)/G 

of reductive homomorphisms from vri(X) to G modulo conjugation. The reductiveness 
condition ensures that this orbit space is Hausdorff, and in fact 'R-{G) is a real analytic 
variety. The geometry and topology of these moduli spaces, though clearly reflective of 
properties of both X and G, is still far from fully understood, especially in the case where 
G is non-compact. In this paper we consider the non-compact groups for which the 
homogeneous space G/H, where if C G is a maximal compact subgroup, is a Hermitian 
symmetric space. By the Cartan classification of irreducible symmetric spaces, it thus 
suffices for us to consider the groups G = SU(p, g), G = Sp(2n, M), G = S0*(2ra) and 
G = S0o(2,n). We concentrate mainly on the most primitive topological property of 
TZ{G), namely the number of connected components. 

The first division of TZ{G) into disjoint closed subspaces comes from the correspon- 
dence between representations of vri(X) and fiat principal bundles over X. Every repre- 
sentation p : 7ri(X) G carries a topological invariant which is the characteristic class 
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d E Til {G) of the flat G-bundle corresponding to p. This class measures the obstruction 
to lift p to a representation of iii{X) in the universal cover of G. The subvarieties 
TZd{G) C TZ{G), consisting of representations with a fixed value of the invariant, form 
disjoint closed subspaces but not necessarily connected components. The problem is to 
count and understand the distinct components of each of the TZd{G). 

For compact groups G, it is well-known that for every d G 7ri(G), the moduli space 
TZd{G) is non-empty and connected. One way to see this is to choose a complex structure 
on X and to use the theory of holomorphic bundles on the resulting Riemann surface. 
When G = SU(n), the topological invariant is trivial, since SU(n) is simply connected, 
and by a theorem of Narasimhan and Seshadri [31], 7?.(SU(n)) can be identified with the 
moduli space of polystable vector bundles of rank n and trivial determinant, which is 
connected. A similar result was proved by Ramanathan [33] for every connected compact 
semisimple Lie group G. He identified TZdiG) with the moduli space of polystable 
holomorphic principal (j>"^-bundles over X with topological class d G 7ri(G), where G'^ 
is the complexification of G, and showed that this moduli space is connected. 

Holomorphic methods can also be used when G is a complex semisimple Lie group. 
In place of a holomorphic principal bundle, the holomorphic object corresponding to a 
representation is now a G-Higgs bundle, i.e. a pair consisting of a holomorphic G-bundle 
and a holomorphic section of the adjoint bundle twisted with the canonical bundle of 
X. A combination of theorems by Hitchin [25] and Donaldson [TJ] for G = SL(2,C) 
and Simpson [SB] and Corlette [13] for general G identify TZd{G) with M.d{G), the 
moduli space of polystable G-Higgs bundles with fixed topological class. Morse-theoretic 
methods introduced by Hitchin [25j prove the connectedness of M.d{G) by relating it to 
that of the moduli space of polystable holomorphic principal G-bundle^j. 

The situation is very different if G is a non-compact real form of a semisimple complex 
Lie group. The simplest case is G = SL(2, M). In this case 7ri(G) = Z and the topological 
invariant (i G Z of a representation is the Euler class of the corresponding fiat SL(2, M)- 
bundle. The Milnor-Wood inequality says that TZd{G) is empty unless \d\ ^ f? — 1, where 
g is the genus of X. In [20], Goldman showed that 7^±(g_i)(G) has 2^^ components 
consisting of discrete faithful representations, each of which can be identified with the 
Teichmiiller space of X. Later in [21] he showed that TZd{G) is connected for \d\ < g — 1. 
This was also proved by Hitchin [25] using Higgs bundle methods. 

The results for G = SL(2, M) can be generalized in two ways. The first goes back to 
|26j where Hitchin extended the results from SL(2,M) to G = SL(n, M). Using Higgs 
bundles, he counted the number of connected components and, moreover, for any split 
real form identified a component homeomorphic to M'^'™"^^^^"^-' and which naturally 
contains a copy of Teichmiiller space. This component, known as the Teichmiiller or 
Hitchin component, has special geometric significance. In the case of SL(3,]R), Choi 
and Goldman [TH [T2] showed that the representations in the Hitchin component are 
discrete and faithful and correspond to convex projective structures on the surface. 
More recently, Labourie [2H] has shown for G = SL(ri, M) that these representations 
are discrete and faithful and are related to certain Anosov geometric structures, and 



-^Other methods to prove that Md{G) is connected had been used by Goldman [51] for G = SL(2, C) 
and G — PSL(2,C) and by J. Li [55] for an arbitrary semisimple complex Lie group G. 
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analogous results have been obtained for G = Sp{2n, M) by Burger, lozzi, Labourie and 
Wienhard [8j. 

The second generalization from G = SL(2, M) exploits the fact that the homogeneous 
space G/H, where if C G is a maximal compact subgroup, is Hermitian symmetric. 
Indeed, SL(2, M)/S0(2) is the hyperbolic plane. This generalization is the main focus 
of this paper. In particular, we review how the theory of Higgs bundles is used in 
the general case of a non-compact real form G such that the symmetric space G/H is 
Hermitian. 

We start by introducing the appropriate notion of a G-Higgs bundle when G is any 
connected reductive real Lie group. The information required to define such a Higgs 
bundle includes a choice of maximal compact subgroup H C G and a Cartan decompo- 
sition = P) + m of the Lie algebras. The correct notion of a Higgs bundle then turns 
out to be a pair {E, ip), where E is an ii'^-bundle (where H"^ is the complexification of 
H) and the Higgs field (p takes values in the complexification m'-' of m. 

Topological classes of E are characterized by elements d G tti{H) = tti{G). When 
G is semisimple and G/H is an irreducible Hermitian symmetric space, the torsion- 
free part of TTi{H) is isomorphic to Z (in fact, for all the classical groups that we will 
study 7ii{H) = Z, except in the cases G = 800(2,72) with n ^ 3, in which cases 
7ri{H) = Z © Z2). This gives an integer invariant known as the Toledo invariant. If 
M.d{G) is the moduli space of polystable G-Higgs bundles with fixed topological class 
of E, the theorem of Corlette [13] and an adaptation of the arguments of Simpson in 
[36] identify TZd{G) = Aid{G) as real analytic varieties. In a direct generalization of 
the result for G = SL(2,M), these moduli spaces are non-empty only for values of d 
satisfying an inequality of Milnor-Wood type (proved by Domic and Toledo and 
also by Turaev [IDj for the symplectic group) given by 

\d\^Tk{G/H){g-l), 

where rk(G/if) is the rank of the symmetric space G/H. For the semisimple classical 
groups defining irreducible Hermitian symmetric spaces, namely G = SU{p, q), Sp(2n, M), 
S0*(2n) and SOo(2,?t,), we show that this inequality is a consequence of semistability 
of the Higgs bundle. 

Representations with maximal Toledo invariant, so-called maximal representations, 
are of particular geometric interest, as is already clear in the case of G = SL(2,M) 
where, as mentioned above, they are just the uniformizing representations. Maximal 
representations have been the subject of extensive study by Burger, lozzi and Wien- 
hard [9l HSl [To] using methods of bounded cohomology. Among other things they show 
that maximal representations are discrete and faithful, generalizing Goldman's theorem 
for SL(2,R) mentioned above. Another important result proved by them is that any 
maximal representation is in fact reductive, thus the restriction to reductive represen- 
tations inherent in the Higgs bundle approach is unnecessary in the case of maximal 
representations. 

Our main concern in this paper are maximal representations. In this case one finds 
that the geometry of G/H is important. In particular, the Shilov boundary S of the 
realization oi G/H as a bounded symmetric complex domain plays a key role. There are 
two cases to consider, depending on whether G/H is or is not of tube-type. In the first 
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case, G/H can be realized as tube domain over a symmetric cone ^7 = G' / H' . Moreover, 
the Shilov boundary S is symmetric space of compact type, and the homogeneous space 
G'/H' is the non-compact dual of 5*. This happens for the groups G = SU(ra,n) 
G = Sp(2n, M), G = S0*(2n) with n even and G = S0o(2, n). In these cases the moduli 
space A4d{,G) with d maximal can be identified with another moduli space related to 
G'. This correspondence which we call Cayley correspondence, allows us to detect new 
topological invariants for the maximal representations. 

In the non-tube cases (viz. G = SU(p, g) with p ^ q and G = S0*(2n) with n 
odd), let G C G define the maximal tube-type space isometrically embedded in G/H. 
Then any maximal representation reduces to a representation in the normalizer Ng{G). 
This leads to a description of the moduli space AidiG) with d maximal as a fibration, 
whose fibres are isomorphic to the moduli space of G-Higgs bundles with maximal 
Toledo invariant, and whose base is the moduli space of polystable holomorphic H"'^- 
bundles, for a certain compact group H", which can de defined in terms of the Shilov 
boundaries of G and G. This generalizes the rigidity results of Toledo [39j for p = 1 and 
Hernandez [23] for p = 2 (and in the case p > 2 for representations satisfying a certain 
non- degeneracy condition). These two results were generalized by the authors to any 
reductive representation and arbitrary p in [21 S] and shortly afterwards it was shown in 
general by Burger, lozzi and Wienhard [S] that any maximal representation stabilizes a 
maximal tube type subdomain of G/H. It was this latter result that made us aware of 
the importance of the tube type condition for the study of maximal representations. 

Finally, we count the number of connected components of the moduli spaces TZd{G) 
when d corresponds to maximal values of the Toledo invariant. The results are sum- 
marized in Table [2] and contain as special cases results obtained for specific groups by 
Goldman [21], Hitchin |25j, Xia [331 HS], Xia-Markman |30j, and in joint work involving 
Mundet i Riera and the authors [HI [221 IH HHj (iii fact many of these references give a 
complete count, for all values of the Toledo invariant). 

The method we use to make the final count of components is based on the Morse 
function defined by Hitchin, using the L^-norm of the Higgs field. The key steps involve 
characterizing the subvariety of local minima of this function and counting the number 
of components of these. 

Acknowledgements. The authors thank Nigel Hitchin, Bill Goldman, Ignasi Mundet i 
Riera, Domingo Toledo, Frangois Labourie, S. Ramanan, Joseph Wolf, Marc Burger, 
Alessandra lozzi, and Anna Wienhard for numerous useful conversations and shared 
insights. Oscar Garci'a-Prada thanks IHES for its hospitality and support. 

2. Surface group representations and G-Higgs bundles 

2.1. Surface group representations. Let X be a closed oriented surface of genus g 
and let 

9 

7ii{X) = {ai,bi, . . . ,ag,bg : ]^[aj,6j] = l} 

i=l 
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be its fundamental group. Let G be a connected reductive real Lie group. By a rep- 
resentation of vri(X) in G we understand a homomorpliism p: 7Vi{X) G. The set 
of all such homomorphisms, Hom(7ri(X), G), can be naturally identified with the sub- 
set of consisting of 25f-tuples {Ai, Bi . . . , Ag, Bg) satisfying the algebraic equation 
11^=1 — 1- This shows that Hom(7ri(X), G) is a real analytic variety, which is 

algebraic if G is algebraic. 

The group G acts on Hom(7ri(X), G) by conjugation: 

{9 ■ P){l) = 9p{l)9~^ 

for (7 G G, p G Hom(7ri(X), G) and 7 G 7ri(X). If we restrict the action to the subspace 
Hom'''(7ri(X), G) consisting of reductive representations, the orbit space is Hausdorff. By 
a reductive representation we mean one that composed with the adjoint representation 
in the Lie algebra of G decomposes as a sum of irreducible representations (when G is 
compact every representation is reductive). Define the moduli space of representations 
of vri(X) in G to be the orbit space 

7^(G) = Hom+(7ri(X), G)/G 

with the quotient topology. 

Given a representation p: 7ri(X) G, there is an associated flat G-bundle on X, 
defined as Ep = X Xp G, where X X is the universal cover and tti{X) acts on 
G via p. This gives in fact an identification between the set of equivalence classes of 
representations Hom(7ri (X), G)/G and the set of equivalence classes of fiat G-bundles, 
which in turn is parameterized by the cohomology set H^{X,G). We can then assign 
a topological invariant to a representation p given by the characteristic class c(p) : = 
c{Ep) G vri(G) corresponding to Ep. To define this, let G be the universal covering 
group of G. We have an exact sequence 

1 — > 7ri(G) — >G — >G — >1 
which gives rise to the (pointed sets) cohomology sequence 
(2.1) H\X, G) — > H\X, G) H\X, 7ri(G)). 

Since vri(G) is abelian, we have 

if2(x,7ri(G)) = 7ri(G), 

and c{Ep) is defined as the image of E under the last map in fl2.ll) . Thus the class 
c{Ep) measures the obstruction to lifting Ep to a flat G-bundle, and hence to lifting p 
to a representation of tti{X) in G. For a fixed d G 7ri(G), the moduli space of reductive 
representations TZd{G) with topological invariant d is defined as the subvariety 

n^iG) := {p G 7^(G) : c(p) = d}. 

2.2. G-Higgs bundles. Let now X be a compact Riemann surface and let K be its 
canonical line bundle. Let G be a connected reductive real Lie group. Let if C G be 
a maximal compact subgroup, and g = I) + m he the Cartan decomposition of q. A 
G-Higgs bundle over X is a pair {E, (f) consisting of a principal holomorphic if'^-bundle 
E over X and a holomorphic section of E{m^) ® K, i.e. if G if°(X, E{xrf) ® K), where 
E{m^) is the bundle associated to E via the isotropy representation of H'^ in m^. 
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If G = GL(n, C) (with its underlying real structure), we recover the original notion of 
Higgs bundle introduced by Hitchin [2S], consisting of a holomorphic vector bundle E : = 
ElC^) — associated to a principal GL{n, C)-bundle E via the standard representation 
— and a homomorphism 

$ : E — >E®K. 

The Higgs bundle (E, $) is said to be stable if 

degr ^ degE 

^ ■ ^ rankE' rankE 

for every proper subbundle E' C E such that $(E') C K' ® K. The Higgs bundle 
(E, $) is polystable if (E, $) = ©j(Ei,$i) where (Ei,$j) is a stable Higgs bundles and 
degEj/rankEj = degE/rankE. The moduli space of polystable Higgs bundles A4{n,d) 
is defined as the set of isomorphism classes of polystable Higgs bundles (E, $) with 
rankE = n and degE = d. Another important concept is that of semistability which 
is defined by replacing the strict inequality in fl2.2p by the weaker inequality. It is 
immediate that polystability implies semistability. 

Similarly, there is a notion of stability, semistability and polystability for G-Higgs 
bundles. If G C GL(?2, C) is a classical group, to a G-Higgs bundle we can naturally 
associate a GL(n, C)-Higgs bundle. The polystability of a G-Higgs bundle is in fact 
equivalent to the polystability of the corresponding GL(n, C)-Higgs bundle. However, a 
G-Higgs bundle can be stable as a G-Higgs bundle but not as a GL(n, C)-Higgs bundle 
([!]). Now, topologically, if'^-bundles E on X are classified by a characteristic class 
d = c{E) G 7ri(if^) = ni{H) = vri(G), and for a fixed such class d, the moduli space 
of polystable G-Higgs bundles Aid{G) is defined as the set of isomorphism classes of 
polystable G-Higgs bundles {E, ip) such that c{E) = d. 

2.3. Correspondence of moduli spaces. We assume now that G is semisimple. With 
the notation of the previous sections, we have the following. 

Theorem 2.1. Let G be a connected non-compact semisimple real Lie group. There is 
a homeomorphism lZd{G) = M.d{G). 

Remark 2.2. This correspondence is in fact an isomorphism of real analytic varieties. 

Remark 2.3. There is a similar correspondence when G is reductive, replacing the fun- 
damental group of X by its universal central extension. 

The proof of Theorem 12.11 is the combination of two existence theorems for gauge- 
theoretic equations. To explain this, let Eg be a G°° principal G-bundle over X with 
fixed characteristic class d G vri(G) = tti{H). Let D be a G-connection on Eg and 
let Fd be its curvature. If D is fiat, i.e. Fr, = 0, then the holonomy of D around a 
closed loop in X only depends on the homotopy class of the loop and thus defines a 
representation of tti{X) in G. This gives an identificatior@, 

7^d(G) ^ {Reductive G-connections D : Fd = 0}/'^, 



^even when G is complex algebraic, this is merely a real analytic isomorphism, see Simpson |361 1371 

|3H] 
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where, by definition, a fiat connection is reductive if tlie corresponding representation 
of 7ii{X) in G is reductive, and ^ is tlie group of automorpliisms of — the gauge 
group. Let ho be a fixed reduction of Eg- to a C°° if-bundle E^- Every G-connection 
D on Eg decomposes uniquely as 

D = dA + ^, 

where d-A is an iJ-connection on E^ and ip G EH(m)). Let Fa be the curvature 

of dA- We consider the following set of equations for the pair (d^, V')- 

FA + l[^,ij] = 

(2.3) dA^ = 

d\^ = 0. 

These equations are invariant under the action of Jf, the gauge group of 'Eh- A theorem 
of Corlette p!3], and Donaldson |T5] for G = SL(2, C), says the following. 

Theorem 2.4. There is a homeomorphism 

{Reductive G -connections D : Fd = 0}/^ = {(ciA, ^) satisfying {\2.3^ }/J^. 

The first two equations in (12. 3p are equivalent to the flatness of D = dA + "ip, and 
Theorem 12.41 simply says that in the ?f -orbit of a reductive fiat G-connection Dq we can 
find a flat G-connection D = (y'(-Do) such that if we write D = dA + ip, the additional 
condition d\ip = is satisfled. This can be interpreted more geometrically in terms 
of the reduction h = giho) of E^ to an if-bundle obtained by the action of (yf G 5f on 
/zq. Equation d^'i/' = is equivalent to the harmonicity of the 7ri(X)-equivariant map 
X G/H corresponding to the new reduction of structure group h. 

To establish the link with Higgs bundles, we consider the i^-bundle Eh and the 
moduli space of solutions to the Hitchin's equations for a pair {dA, '■p) consisting of an 
if-connection dA and G Q}'^{X,EH{vcf)y 

(2.4) FA-[ip,T{ip)] = Q 

Ba^P = 0. 

Here Ba is the (0, 1) part of dA, which deflnes a holomorphic structure on Eh, and r is 
the conjugation on defining its compact form. The gauge group of Eh acts on the 
space of solutions defining the moduli space of solutions. A theorem of Hitchin [2B] for 
G = SL(2, C) and Simpson [25] for an arbitrary semisimple complex Lie group G can 
be adapted to a semisimple real Lie group G [7J to give the following. 

Theorem 2.5. There is a homeomorphism 

Md{G)^{{dA,^) satisfying l^}/J^. 

To explain this correspondence we interpret the moduli space of G-Higgs bundles in 
terms of pairs {Be, f) consisting of a 9-operator on the if'^-bundle Ehc obtained from 
Eh by the extension of structure group H C H'^, and ip G f2^'°(X, Enc^mP)) satisfying 
Be'^ = 0. Such pairs are in correspondence with G-Higgs bundles {E, ip), where E is the 
holomorphic if''-'-bundle defined by the operator Be on Ehc and Be^ = is equivalent 
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to (f e H'^{X,E{xrf) (g) K). The moduli space of polystable G-Higgs bundles Md{G) 
can now be identified with the orbit space 

{Polystable (Be,^) : dEV = 0}/J^^, 

where J^'^ is the gauge group of Ejjc, which is in fact the complexification of Jif. Since 
there is a one-to-one correspondence between if-connections on Eh and 9-operators on 
Effc, the correspondence given in Theorem 12.51 can be interpreted by saying that in the 
Jif^-oihit of a polystable G-Higgs bundle {dEo,'^o) we can find another Higgs bundle 
{Be, (p) whose corresponding pair {(Ia, ^) satisfies Fa — [v^, T{ip)] = 0, and this is unique 
up to iJ-gauge transformations. 

To complete the circle, leading to Theorem 12.11 we just need the following. 

Proposition 2.6. The correspondence {dA,<p) ^ {dAi'4' V ~ '^i'^)) defines a home- 
omorphism 

{idA,(p) satisfying (^2^} / = {{dA, ^p) satisfying ffOj) }/^. 

For the benefit of the reader we have outlined the correspondences between the various 
moduli spaces explained in this Section in a diagram (12. 5p below. The notation used is 
as follows: 

• Ejjc ^ X is a smooth if ^-bundle, 

— Be is a holomorphic structure on Ej^c, 

— n^'%EHc{xxf), and 

— Jif^ is the gauge group of Eji^c; 

• Ec ^ X is a smooth G-bundle, 

— D is a connection on Eg, and 

— ^ is the gauge group of E^; 

• Eh —>■ X is a. smooth if -bundle (a reduction of Efjc and Eg) , 

— y4 is a connection ouEh, 

— ip e Q^^Enixn), and 

— is the gauge group of Eh', 

and the maps (1), (2) and (3) are homeomorphisms given by 

(1) idA,^)^iBA,v^) [23 ESI E]; 

(2) {dA, if) ^ (dA, tp = (p- T{ip)); 

(3) {dA, ^ D = dA + 

The following diagram outlines the correspondences between the various moduli 
spaces explained in this Section (cf. Theorems 12.11 [2^ and 12 . 51 and Proposition 12. 6p . 
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(2.5) 



l\\ I (2) 

3. ISOMETRY GROUPS OF HERMITIAN SYMMETRIC SPACES 

3.1. G-Higgs bundles for the classical Hermitian symmetric spaces. Our goal 
in this paper is to study representations of the fundamental group in the case in which 
G/H is a. Hermitian symmetric space. This means that G/H admits a complex structure 
compatible with the Riemannian structure of G/H, making G/H a. Kahler manifold. If 
G/H is irreducible, the centre of f) is one-dimensional and the almost complex structure 
on G/H is defined by a generating element in J G Z{i)) (acting through the isotropy 
representation on m"-'). This complex structure defines a decomposition 



tn = m+ + m_ , 

where m+ and m_ are the (1, 0) and the (0, 1) part of respectively. Table [1] (see 
Sec. [7]) shows the main ingredients for the irreducible classical Hermitian symmetric 
spaces. 

Let now {E, ip) be a G-Higgs bundle over a compact Riemann surface X. The decom- 
position m"' = m+ + m_ gives a vector bundle decomposition _E(m^) = -E(m+) ©i?(m_) 
and hence 

^ = (/?, 7) G H%X, E{m+) ^K)® H%X, E{m.) ® K) = H%X, E{xrf) ® K). 

In Table [3|, we describe the G-Higgs bundles for the various groups appearing in 
Table [TJ It is sometimes convenient to replace the if-'-bundle ii^ by a vector bundle 
associated to the standard representation of H"^. For example, for G = SU(p, q), 

H^ = S{GL{p, C) X GL(g, C)) := {{A, B) e GL{p, C) x GL(g, C) : det 5 = (det A)'^}, 

and the iJ'^-bundle E is replaced by two holomorphic vector bundles V and W or rank 
p and q, respectively such that det W = (det V)~^. 

As mentioned in Sec. 12.21 via the natural inclusion G C G'^ C SL(iV, C) for G in 
Table [31 to a G-Higgs bundle {E,ip) we can naturally associate an SL(A^, C)-Higgs 
bundle (E, where E is a holomorphic vector bundle with trivial determinant. This 
is a very useful correspondence that we also describe in Table [31 

3.2. Toledo invariant and Milnor— Wood inequalities. Let G be a semisimple Lie 
group such that G/H is an irreducible Hermitian symmetric space. Then the torsion- 
free part of TTi{H) is isomorphic to Z and hence the topological invariant of either a 
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representation of vri(X) in G, or of a G-Higgs bundle, is measured by an integer d E Z, 
known as the Toledo invariant. In the classical cases described in Tabled] this coincides 
with the degree of a certain vector bundle. In fact, besides G = S0o(2,n) with n ^ 3, 
for which ni{H) ^ Z © Z2, for all the other groups in Table □ tti (if) = Z. 

Let G = S\J{p,q). As we can see from Table |3l an SU(p, g)-Higgs bundle over X is 
defined by a 4-tuple (V, W, /?, 7) consisting of holomorphic vector bundles V and W of 
rank p and q, respectively, such that det W = (det V)~^, and homomorphisms 

(3:W — >V(»K and 7:1/ — >W®K. 

If (V, W, j3, 7) is polystable then the associated Higgs bundle (E, $) with 

E = V®W and $=(° ^) 

is also polystable and in particular semistable. Applying the semistability numerical 
criterion to special Higgs subbundles defined by the kernel and image of $ (see [1]) we 
obtain 

(3.1) d ^ rank(7)(^- 1) 

(3.2) ^ rank(/3)(^- 1), 
which gives the inequality 

(3.3) \d\^mm{p,q}ig-l), 

that generalizes the inequality of Milnor-Wood for G = SU(1, 1). Using similar argu- 
ments one can show the various Milnor-Wood type inequalities for G in Table [31 In 
fact, the inequalities for G = Sp(2n, M) and G = S0*(2n) can be obtained from that of 
SU(n, n), via the natural inclusion of these two groups in SU(n, n). These inequalities 
for representations of 7ri(X) in G have been proved by Domic and Toledo [H] using 
other methods. One can observe that the bound for the Toledo invariant can uniformly 
written as Taiak{G/ H){g — 1). 

Remark 3.1. Duality gives an isomorphism Aid{G) = Ai^diG) for every G in Table [31 
For example, for SU(p, q) this isomorphism is defined by the map 

{V,W,P,j)^{V*,W*,j\P'). 

There is hence no loss of generality in considering only the case with positive Toledo 
invariant, which we will do from now on. 

Our main interest in this paper is the case when the Toledo invariant d is maximal, 
that is \d\ = (imax- Let 

-Mmax(G) :=A^._(G) 
be the moduli space of G-Higgs bundles with maximal Toledo invariant, and similarly 
'^max(G') := 7^(i,„ax(^) the corresponding moduli space of representations. 

Our goal in the following sections is to study the geometry of maximal Higgs bundles 
and to count the number of connected components of A4max{G) for G in Table [31 
The case of G = SU(1, 1) ^ SL(2,M) and G = S0o(2, 1) = PSL(2,R) was studied 
by Goldman [20], who showed that the moduli space of maximal representations in 



MAXIMAL SURFACE GROUP REPRESENTATIONS 



11 



SL(2, M) has 2^^ connected components isomorphic to Teichmiiller space, all of which 
get identified when we consider representations in PSL(2,]R). 

3.3. Low rank phenomena. There are certain low rank coincidences between the 
Higgs bundles given in Table [31 coming from the special low dimensional isomorphisms 
between Lie groups. 

The most basic instance of this is isomorphism SU(1, 1) = Sp(2,M) which clearly 
gives rise to equivalent Higgs vector bundle data (E, $) , namely a line bundle M (which 
equals the V of Table ED and a pair of sections (3 e H^{M^K) and 7 G H°{M-^K) — 
we note that this is also the data corresponding to a SL(2, M)-Higgs bundle (cf. Hitchin 
[23]). as is to be expected from the isomorphism Sp(2,M) = SL(2,M). 

In a similar way, the covering SU(1, 1) = Sp(2,M) = SpinQ(2, 1) — > S0o(2, 1) shows 
that a Higgs bundle for one of the former groups gives rise to one for the latter. Explic- 
itly, if (M, (3, 7) is as above, then the associated S0o(2, 1)-Higgs bundle (E = V ®W,^) 
has V = ® M-2 and W = O; thus the L of Table E] is L = M^. Note that the 
Toledo invariants are related by 

c^Spino(2,i) = deg(M) = ^deg(L) = ^4oo(2,i), 

and that a S0o(2, 1)-Higgs bundle lifts to a SpinQ(2, 1)-Higgs bundle if and only it has 
even Toledo invariant. 

Analogous phenomena occur for various other (local) isomorphisms, here we shall 
describe exphcitly just one more such situation of particular interest, corresponding to 
the covering Sp(4,M) = Spino(2,3) SOo(2,3). Let (V,/3,7) be the vector bundle 
data corresponding to a Sp(4, M)-Higgs bundle as in Tableland let L = A'^V be the 
determinant bundle of the rank 2 bundle V. Then S'^V has a non-degenerate quadratic 
form with values in defined by 

Q{x ®y,x' ® y') = (x A x') ® {y A y') 

and thus we obtain an orthogonal bundle {W^ Qw) letting 

W = S^V®L-^ 

with the induced quadratic form Qvk- Thus we have the required bundle data (W, Qw) 
and L to define a S0o(2, 3)-Higgs bundle. Since S'^V = W ^ L = W* ^ L, the section 
f3 e H^{S'^V ®K) can be viewed as a section of Hom(lV, L)®K and, similarly, 7 can be 
viewed as a section of Hom(iy, L~^)®K. Note that, since deg(V") = deg(A^V") = deg(L), 
in this case the Toledo invariants are the same. However, the topological classification of 
5*00(2, 3) bundle involves two classes, namely the degree of L (i.e. the Toledo invariant) 
and the second Stiefel- Whitney class W2{W, Qw) G Z/2 of the S0(3, C) bundle {W, Qw)- 
One can show without too much difficulty that an S0o(2, 3)-Higgs bundle given by the 
data (L, W, Qw, P, 7) lifts to a Sp(4, ]R)-Higgs bundle if and only if 

deg{L) = W2{W,Qw). 

Remark 3.2. The group SOo(2,2) is special because the associated Hermitian symmet- 
ric space is not irreducible; in fact SOo(2,2) is isogenous to SL(2,M) x SL(2,M) = 
SpinQ(2,2). Of course, the results for irreducible Hermitian symmetric spaces given 
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here, can be applied to obtain results for isometry groups of all Hermitian symmetric 
spaces. For this reason we shall exclude this group from our considerations in this paper. 

4. Maximal Toledo invariant 

4.1. Tube type condition. We refer to [Ml [231 1211 IM] for details regarding this sec- 
tion. 

It is well-known that a Hermitian symmetric space of non-compact type G/ H can be 
realized as a bounded symmetric domain. For the classical groups this is due to Cartan, 
while the general case is given by the Harish-Chandra embedding G/H — >■ m+ which 
defines a biholomorphism between G/H and the bounded symmetric domain T) given 
by the image of G/H in the complex vector space m+. Now, for any bounded domain T> 
there is the Shilov boundary of V which is defined as the smallest closed subset S of the 
topological boundary dV for which every function / continuous on V and holomorphic 
on T> satisfies that 

\f{z)\ ^ max I /(if) I for every z eV. 

The Shilov boundary 5* is the unique closed G-orbit in dT>. 

The simplest situation to consider is that of the hyperbolic plane. The Poincare disc is 
its realization as a bounded symmetric domain. However, we know that the hyperbolic 
plane can also be realized as the upper-half plane. There are other Hermitian symmetric 
spaces that, like the hyperbolic plane, admit a realization similar to the upper-half plane. 
These are the tube type symmetric spaces. 

Let be a real vector space and let Q G V be an open cone in V. A tube over the 
cone f2 is a domain of the form 

T^ = {u + iv eV^,ueV,v e Q}. 

A domain V is said to be of tube type if it is biholomorphic to a tube Tq. In the case 
of a symmetric domain the cone Q is also symmetric. An important characterization of 
the tube type symmetric domains is given by the following. 

Proposition 4.1. LetV be a bounded symmetric domain. The following are equivalent: 
(i) is of tube type, 
(a) dimes' = dime "P. 

(Hi) S is a symmetric space of compact type. 

There is a generalization of the Cayley map that sends the unit disc biholomorphically 
to the upper-half plane. Let V be the bounded domain associated to a Hermitian 
symmetric space G/H. Acting by a particular element in G, known as the Cayley 
element.^ one obtains a map 

c : V — > m+ 

which is called the Cayley transform. A relevant fact for us is the following. 

Proposition 4.2. Let D be the symmetric domain corresponding to the Hermitian 
symmetric space G/H. Let V be of tube type. Then the image by the Cayley transform 
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c{T>) is biholomorphic to a tube domain Tq where the symmetric cone Q is the non- 
compact dual of the Shilov boundary ofV. In fact the Shilov boundary is a symmetric 
space isomorphic to H/H' for a certain subgroup H' C H, and Vt = G'/H' is its non- 
compact dual symmetric space. 

Proposition 4.3. (1) The symmetric spaces defined by Sp(2n, M), S0o(2,r;,) are of 
tube type. 

(2) The symmetric space defined by SU(p, q) is of tube type if and only if p = q. 

(3) The symmetric space defined by S0*(2n) is of tube type if and only if n is even. 

For a tube type classical irreducible symmetric space G/H, Table H] indicates the 
Shilov boundary S = H/H', its non-compact dual Q = G'/H', the isotropy representa- 
tion space m' and its complexification m' , corresponding to the Cartan decomposition 
of the Lie algebra g' = f)'+m' of G'. The vector space m' has the structure of a Euclidean 
Jordan algebra, where the cone Q is realized. 

The study of certain problems in non-tube type domains can be reduced to the tube 
type thanks to the following. 

Proposition 4.4. Let G/H be a Hermitian symmetric space of non-compact type. 
There exists a subgroup G G G such that G/H C G/H is a maximal isometrically 
embedded symmetric space of tube type, where H G G is a maximal compact subgroup. 

Table O gives the maximal symmetric space of tube type isometrically embedded in 
the two series of irreducible classical symmetric spaces of non-tube type. We describe 
also the Shilov boundaries of G/H and G/H which are of the form S = H/H', and 

S = H/H', respectively. Notice that in the non-tube case the Shilov boundary S" is a 
homogeneous space H/H' but it is not symmetric. 

4.2. Tube type domains and Cayley correspondence. It turns out that the be- 
haviour of maximal representations and G-Higgs bundles is governed by the tube type 
nature oi G/H and the geometry of its Shilov boundary. To explain this, let L be a 
holomorphic line bundle over X. Let G be a real reductive Lie group. Let if C G be 
a maximal compact subgroup, and g = [) -|- m be the Cartan decomposition of g. An 
L-twisted G-Higgs pair is a pair [E, cp) consisting of a principal holomorphic if^-bundle 
E and a holomorphic section of E{m^) L, where E{xn^) is the bundle associated to 
E via the isotropy representation of H'^ in m^. Note that a G-Higgs bundle is simply 
a if-twisted G-Higgs pair. Let 7V1l(G) be the moduli space of polystable L-twisted 
G-Higgs pairs. 

Theorem 4.5. Let G be a connected semisimple classical Lie group such that G/H is 
a Hermitian symmetric space of tube type, and let Q = G'/H' be the non-compact dual 
of the Shilov boundary S = H/H' of G/H. Then 

(4.1) M^,,iG)=MK^iG'). 

In analogy with the Cayley transform of the previous section, we call the isomorphism 
given in Theorem 14.51 Cayley correspondence. To prove this correspondence, it suffices 
to do it for all G in Table HI We will sketch the main arguments case by case. See 
[221 [31 H [m [Tg E] for details. 
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• G = SU(n,n): 

An SU(n, n)-Higgs bundle over X is defined by a 4-tuple (V,iy,/5,7) consisting of 
two liolomorpliic vector bundles V and W of rank n such that det W = (det V)~'^, and 
homomorphisms 

p:W — >V0K and : V — ^ W K. 

Suppose that the Toledo invariant d = deg V is maximal and positive, that is, d = 
n{g — 1). From (13. ip we deduce that 7 must be an isomorphism. Let 6 : W ^ W ^ 
be defined as 6* = (7 ® Ik) o /5, where Ik '■ K ^ K is the identity map. 

The condition det = (detl^)^^, together with the isomorphism 7 imply that 
(det WY — K~"- Now, if we choose a square root of the canonical bundle, Lq = K^^'^, 

and define W = W ® Lq, we have that (det W) = O and hence the structure group of 
W is the kernel of the group homomorphism GL(n, C) C* given hy A ^ (det A)^. 
This kernel is isomorphic to the semidirect product SL(n, C) X1Z2, where Z2 = {±/} and 
has then two connected components. The choice of a 2-torsion element in the Jacobian 
of X for det W defines an invariant that takes 2^^ values. 

hetO:W^W®K'^he defined as ^ = 6* (g) . The map 

(4.2) {V,W,(3,^)^{W,e) 

gives the bijection (jH]) with G' = SL(n,C) x Z2 (see Table |4]). 

• G = Sp(2n,M): 

A Sp(2?2, R)-Higgs bundle over X is defined by a triple (V,/3,7) consisting of a rank 
n holomorphic vector bundles V and symmetric homomorphisms 

(3:V* — >V®K and 7 : 1/ — >V*^K. 

If the Toledo invariant d = degV" is maximal and positive, that is, d = n{g — 1), 
again from (13. ip we deduce that 7 is an isomorphism. Let Lq = K^^"^ be a fixed 
square root of K, and define W = V* ® Lq. Then Q := 7 ® J^-i : W* W is a. 
symmetric isomorphism defining an orthogonal structure on W , in other words, {W, Q) 
is an 0(n, C)-holomorphic bundle. The i^^-twisted endomorphism 6 : W ^ W ® K"^ 
defined by 6* = (7 (g) Ik^Lo) ° 13 ® Ilo is Q-symmetric and hence {W, 6) defines a K'^- 
twisted GL(n, ]R)-Higgs pair, from which we can recover the original Sp(2r;,, ]R)-Higgs 
bundle, giving the bijection (14. ip in this case. 

• G = S0*(2n), with n = 2m: 

A S0*(2n)-Higgs bundle is over X is defined by a triple (V, 7) consisting of a rank 
n holomorphic vector bundles V and skew-symmetric homomorphisms 

(3:V* — yV^K and 7 : — >V*®K. 

Since n = 2m is even, the maximal value of the Toledo invariant (see Table [3]) is 
c^max = n{g — 1). If d = n{g — 1) then, as in the previous cases, 7 is an isomorphism, 
and if Lq = K^^"^ is a fixed square root of K, and we define W = V* 1^ Lq, the 
homomorphism u; := 7 ® /^-i : W* — > is a skew-symmetric isomorphism defining 
a symplectic structure on W, that is, (W,u) is a Sp(2m, C)-holomorphic bundle. The 
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X^-twisted endomorphism 9 : W — > W ® K"^ defined by 6* = (7 (g) Ir^Lo) ° 13 ® Ilq is 
in this case skew-symmetric with respect to uj and hence {W, 9) defines a K^-twisted 
G'-Higgs pair for G' = U*(2m). The map (K, /?, 7) 1-^ {W,9) gives the bijection fl4.ip in 
this case. 

• G = S0o(2,n): 

A S0o(2, 'ri)-Higgs bundle is defined by a S0(2, C)-bundle 

where L is a holomorphic fine bundle, and a SO (n, C) -bundle {W,Qw), together with 
homomorphisms 

13 -.W — >L®K and : W — > L'^ ® K. 

The maximal case corresponds to d = degL = 2g — 2. In this situation one can show 
that 7 has (maximal) rank one at all points and hence it is surjective. If we define 
F := ker7, we have a sequence 

(4.3) — >F — >W — >L-^®K — ^0. 

One can show that this sequence splits and F inherits a 0(n — 1, C)-structure. Let 
Lq := (g) K. From the exact sequence we deduce that Lq det F = O and hence 
Lq = O. In other words, = K"^. Now, according to the decomposition W = F ® Lq, 
we can decompose /3 = + P" with : F — > L®K and [3" : Lq — > L®K. Tensoring 
these homomorphisms by Lq, we obtain 9' : F ^ Lq —>■ and 9" : O ^ K^. The map 

{L,W,Qw.P.l)^{F,9',9") 

defines the correspondence (14. ip now. 

In all the cases above we have to show of course that the corresponding (poly) stability 
conditions in Almax(G') and JVij^2{G') are equivalent. 

The correspondence (14.10 brings to the surface new topological invariants of a maxi- 
mal representation — the invariants of the if"^-bundle — which are not a priori "visi- 
ble" . The new invariants will account to a certain extent for the abundance of connected 
components in most cases. 

Remark 4.6. We believe that Theorem 14.51 is true also in the non-classical case. To show 
this it would suffice to check the case of the rank 3 irreducible exceptional domain, which 
is obtained from a real form of E-j. It would be very interesting, however, to find a proof 
independent of classification theory. 

4.3. Non-tube type domains and rigidity of maximal representations. We 

study now maximal G-Higgs bundles and representations when G/H is not of tube 
type (see Table [5]). Let us start with G = SU(p, g) with p ^ q. Without loss of 
generality we assume that p < q. The maximal value of the Toledo invariant is then 
dmax = pig — !)• As shown in [22], 1^, it turns out that there are no stable SU(p, g)- 
Higgs bundles. In fact, every polystable SU(p, g)-Higgs bundle {V,W, jSyj) is strictly 
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semistable and decomposes direct sum 

(4.4) (r, W, (3, 7) = (V^, W\ (3, 7) © (0, W'\ 0, 0), 

of a maximal polystable U(p, p)-Higgs bundle and a polystable GL(g— p, C)-bundle with 

zero Chern class, where V ^ W ® K, with W = im.'^ ® and W" = W/W. 
Since 

det(l^) (g) det(iy') ® (ly") ^ C», 

this means that the SU(p, g)-Higgs bundle reduces to an S(U(p, p) x U(g — p))-Higgs 
bundle. 

We have the exact sequence 

1 ^ SU(j9, p) S(U(p, p) X U(g - p)) ^ S(U(1) xV{q-p))^l 

{A,B)^{det{A),B), 

from which we conclude the following. 

Theorem 4.7. Letp < q. Then the moduli space A^max(SU(p, q)) fibres over M{GL{q — 
p,C)) with fibre isomorphic to 7Wniax(SU(p, p)), where M{GL{q — p,C)) is the moduli 
space of polystable vector bundles of rank q — p and zero Chern class. 

Similarly, for G = S0*(2r;,) with n = 2m + 1, the maximal value of the Toledo 
invariant is rfmax = ('^ ~ ~ 1); and if d = rfmax there are no stable SO*(4m + 2)-Higgs 
bundles and every polystable SO* (4m + 2)-Higgs bundle (V,/3,7) decomposes as 

{V,P,j) = {V',P,j)®{L,0,0), 

where {V, /3, 7) is a maximal polystable S0*(4m)-Higgs bundle, with V = (im7)* ® K 
and L = V/V is a line bundle of degree (see [0] for details). 

We thus have the following. 
Theorem 4.8. 

-Mmax(S0*(4m + 2)) = M^USO*{Am)) x J(X), 
where J{X) is the Jacobian of X. 

Since, as we know from Table \5\ the two cases discussed above are the only ones 
defining classical irreducible Hermitian symmetric spaces of non-tube type, we conclude 
the following. 

Theorem 4.9. Let G be a connected semisimple classical Lie group such that G/H is 
Hermitian symmetric space of non-compact type. Let G G G be a subgroup defining 
the largest isometrically embedded subspace G/H C G/H, and let H" = H'/H' where 

S = H/H' and S = H/H' are the Shilov boundaries of G/H and G/H, respectively. 
Then the following holds: 

(1) Every G-Higgs bundle in 7Wmax(G') is strictly polystable and reduces to a Ng{G)- 
Higgs bundle, where the normalizer of G in G, Ng{G), fits in the exact sequence 

l^G^ Ng{G) H" 1. 
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(2) The moduli space 7Vlmax(G') fibres over M{H" ), with fibre M.nia.x{G), where 
M{H"^) is the moduli space of polystable holomorphic H"'^ -bundles with zero char- 
acteristic class. 

From Theorem 12.11 and the theorems of Narasimhan-Seshadri [31] and Ramanathan 
[33], which identify the moduh space of polystable holomorphic i?"'''-bundles with trivial 
characteristic class with the moduli space of representations of vri(X) in H" ^ we obtain 
the following. 

Theorem 4.10. With the same hypotheses and notation as in Theorem 14.91 we have 
the following: 

(1) Every representation in TZma.x{G) is reducible and factors through a representation 
inNciG). 

(2) The moduli space TZmaxiG) fibres over 1Z{H") , with fibre 7^max(G'), where 1Z{H") 
is the moduli space of representations of 7ii{X) in H" . 

Theorem 14.101 had been proved by Toledo [39] for G = SU(l,g). For general p the 
result had been proved by Hernandez [2^ , under a certain non-degeneracy condition on 
the representation, which he was able to show is always satisfied for p = 2. The result 
was then proved in [31 H] for any reductive representation in SU(p, g). Finally Burger, 
lozzi and Wienhard [9] showed that any maximal representation stabilizes a maximal 
tube type subdomain of G/H C G/H. From this, and their results in [10], Theorem 14. 101 
should follow directly for general G. On the other hand, to generalize Theorems 14.91 
and 14.101 from the Higgs bundle point of view, it suffices to prove corresponding results 
for the only non-tube rank 2 irreducible exceptional domain which is obtained from a 
real form of Eq. 

Remark 4.11. Theorems 14.91 and 14.101 establish a certain kind of rigidity for maximal 
G-Higgs bundles, and hence for surface group representations in G, when G/H is not of 
tube type. Namely, since the expected complex dimension of A4d{G) = dim.]^ Q{g — 1) 
(as can be computed using the deformation theory in Sec. 15.11) . in the non tube situation 
dimiR g + dimK I)" < dimg and hence the dimension of A^max is smaller than expected 
(here 1)" and g are the Lie algebras of G and H" in Theorem 14. 9p . 

The fact that M{H"'^) is connected ([311 [33]) leads to the following Corollary to 
Theorem 14. 9[ 

Corollary 4.12. If G, G and H" are as in Theorem \4-9^ then the number of con- 
nected components o/ A^max(G') is bounded by the number of connected components of 
A4niax(G'). In particular, if AdmaxiG) is connected so is A^max(G). 

5. Morse theory on the moduli space of G-Higcs bundles 

5.1. Deformation theory. Below we shall be doing analysis, in the form of Morse 
theory, on the moduli spaces of G-Higgs bundles and therefore we need a description of 
their tangent spaces. This can be conveniently done using hypercohomology of certain 
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complexes of sheaves. This idea probably has its origin in Welters [42]. A convenient 
reference is Biswas and Ramanan [2]. 

Let {E, (p) be a G-Higgs bundle. The deformation complex of {E, ip) is the following 
complex of sheaves: 

(5.1) C'{E, if) : E{\f ) ^ E{m^) ® K. 

Note that this makes sense because [m''', t)*^] C m*^. 

The following result generalizes the fact that the infinitesimal deformation space of a 
holomorphic vector bundle V is isomorphic to H^^EndV). 

Proposition 5.1. The space of infinitesimal deformations of a G-Higgs bundle {E,ip) 
is isomorphic to the hypercohomology group M.^{C'{E,Lp)). 

In particular, if {E, ip) represents a non-singular point of the moduli space Aid{G) 
then the tangent space at this point is canonically isomorphic to M^{C'{E,(p)). 

For usual holomorphic vector bundles, the analogue of the following result is the 
fact that the only endomorphisms of a stable bundle are the constant multiples of the 
identity. 

Proposition 5.2. Let {E, p) be a stable G-Higgs bundle which represents a smooth 
point of M.d{G). Then 

M°(C"(E, p)) = m\C'{E, ifi)) = 0. 

5.2. Morse theory. The idea of applying Morse theory to the study of moduli of 
holomorphic vector bundles has its origin in the fundamental work of Atiyah and Bott 
[1] . Here the moduli space of stable bundles was studied using equivariant Morse theory 
on the infinite dimensional space of unitary connections. The use of Morse theory in 
moduli spaces of Higgs bundles was introduced by Hitchin [23] • In this section we explain 
how to apply these methods in moduli spaces of G-Higgs bundles. In particular, we give 
a criterion (Corollary 15. 4p for finding the local minima of the Morse function, which is 
extremely useful in the context of problem of counting connected components of the 
moduli space. 

In order to define the Morse function, we shall consider the moduli space AidiG) of 
G-Higgs bundles from the gauge theory point of view, as explained in Sec. 12.31 Thus we 
identify Ai^iG) with the moduli space of solutions to Hitchin's equations (12. 4p . From 
this point of view it makes sense to define 

^ ^ f:MdiG)^R, 

^^•2) M ^ II ||2 

{dA,p) ^ \m\ , 



where Hv^P = Jj^\(p\'^dvol is the L^-norm of (p. Note that this norm is well defined 
because |<y9p is invariant under if-gauge transformations. 

The maps / has its origin in symplectic geometry: away from the singular locus of 
A4d{G) it is a moment map for the hamiltonian S'^-action given by 

e'': idA,p)^idA,e''p). 
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This fact is important for two reasons. Firstly, a theorem of Frankel |T7j guarantees 
that, when Ai^iG) is smooth, / is a perfect Bott-Morse function. Secondly, the critical 
points of / are exactly the fixed points of the S'^-action. 

The function / can be used to obtain information about connected components even 
when A4ci{G) has singularities due to the following result, proved by Hitchin ^25j, using 
Uhlenbeck's weak compactness theorem |41j . 

Proposition 5.3. The function f: AidiG) — M zs a proper map. 

Corollary 5.4. Let M. C M.d{G) he a closed suhspace and let M ^ M. he the suhspace 
of local minima of f on M.. If M is connected, then so is M.. 

5.3. A criterion for minima. In view of Corollary 15.41 it is clearly of fundamental 
importance to have a criterion which allows one to identify the local minima of the 
function /. As has already been pointed out, the critical points of / are just the fixed 
points of the S^-action on M.(i{G). The G-Higgs bundles corresponding to fixed points 
are the so-called Hodge hundles (see Hitchin [251 ES] and Simpson [36j), described in 
the following proposition. 

Proposition 5.5. A polystahle G-Higgs hundle {E, ip) corresponds to a fixed point of 
the action of S"^ on M.d{G) if and only if {E,{p) is a Hodge bundle, i.e., there is a 
semi-simple element ip G if" (£'(())) and decompositions 

k 

E{nf) = ^E{ra% 

k 

in eigen-hundles for such that 

^|£;(f,c), = ik and '^lEinf)^ = ik, 
and, moreover, [ip,ip] = if. 

Notice that the condition [ip, ip] = ip means that 

pe H'^{E{ra^)i^K). 

Hence, if {E, p) is a Hodge bundle as described in the preceding proposition, there is an 
induced decomposition of the deformation complex C*{E, p) defined in (15.11) . as follows: 

C\E,p) = Qci{E,p), 

k 

where for each k we define the complex 

Cl{E, p) : E{\)% ^ E{m%+^ ® K. 

This decomposition gives us a corresponding decomposition of the infinitesimal defor- 
mation space of {E, p): 

n\C'{E,p)) = Qm\Cl{E,p)). 

k 

This decomposition is important because of the following result. 
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Proposition 5.6. Let {E, ip) he a stable G-Higgs bundle which represents a non-singular 
point of Aid{G) . If{E,Lp) represents a fixed point of the -action, then the eigenvalue 
—k eigenspace of the tangent space for the Hessian of f is isomorphic to M^{C^{E,ip)). 
In particular, {E, ip) corresponds to a local minimum of f if and only if 

m\ci{E,ip)) = oyk>o. 

A key result proved in |1] gives a very useful criterion for deciding when the hyper- 
cohomology M.^{C*{E, p)) vanishes. In order to state this resuh, it is convenient to use 
the Euler characteristic of the complex C'{E,p>) defined by 

x{C:{E,p)) = d\mlf{C:{E,p))-dunM\Cl{E,p)) + dimlf{C:{E,ip)). 

Theorem 5.7 (|4i Proposition 4.14]). Let {E,p) be a semi-stable G-Higgs bundle, fixed 
under the action of S-^ . Then 

x{C:{E,p))^0 

and equality holds if and only if a.d{p)) : E{[)'^)k E{m'^)k+i ® K is an isomorphism. 

Together with Proposition 15.21 Theorem 15.71 gives the promised criterion for finding 
the local minima of /. 

Corollary 5.8. Let {E, p>) be a stable G-Higgs bundle which represents a non-singular 
point of M.d{G). Then {E,p>) represents a local minimum of f if and only if 

ad((/.):£;(f)'^)fc-^E(m^),+i®ir 

is an isomorphism for all k > 0. 

6. Minima and counting of components 

6.1. Minima. It is the purpose of this section to describe the local minima of the 
function /: A4d{G) ^ defined in (15.21) for these groups. 

Recall from Remark 13.1 1 that there is no loss of generality in assuming that the Toledo 
invariant is positive. Thus, to all the results stated here for positive Toledo invariant, 
there are parallel results for negative Toledo invariant. 

Since it creates no extra difficulties, we state the following Theorem for arbitrary 
(positive) Toledo invariant, even though we are presently only interested in the case 
of maximal Toledo invariant. The Theorem is proved by using the criterion given in 
Corollary 15. 8t together with an extra argument to deal with strictly polystable G-Higgs 
bundles. 

Theorem 6.1. Let {E, = /3 + 7) be a polystable G-Higgs bundle with positive Toledo 
invariant. 

(1) If G is one of the groups SU(p,g), SO*(2?2) and 800(2,72) (with n 7^ 2,3) then 
{E, (y9 = /5 + 7) represents a local minimum on Ai^iG) if and only if (3 = 0. 

(2) Let {E,(p = /3 + 7) be a polystable Sp{2n,'R)-Higgs bundle with n 7^ 2 and let 
(E, $) = (l^ © V^*, (° ^)) be the associated Higgs vector bundle. Then {E,(p) 
represents a local minimum of f if and only if one of the following situations 
occurs: 
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(a) The vanishing (3 = holds. 

(b) The number n is odd and there is a square root L of the canonical bundle 
K and a decomposition V = Li\:-2["/2l © i:/s:-2[n/2]+2 © ... © LK^[n/2] ^^^/^ 

respect to which 



1 0' 



(6.1) 7= ..• : j and p = 

In this case, necessarily the Toledo invariant is maximal, i.e. deg(V^) = 
n{g - 1). 

(c) The number n is even and there is a square root L of the canonical bundle 
K and a decomposition V = K'^~"- (B K'^~^ (B ■ ■ -(BL'^K" with respect 
to which (3 and 7 are given by (16.11) . ^4/50 in this case, necessarily we are 
in the situation of maximal Toledo invariant, deg(^) = n{g — 1). 

Remark 6.2. The case of G = SU(1, 1) ^ Sp(2,M) = SL(2,M) is covered by both (□) 
and ^ of Theorem O This case (together with G = S0o(2, 1) = PSL(2,M)) was 
studied by Hitchin [25] . 

Remark 6.3. Recall from Remark [3.21 that we have excluded the group SOo(2,2) from 
our considerations — in fact, the results for this group do not fit into the general 
statement given in Theorem 16. 1[ 



Remark 6.4. The minima for the split real group Sp(2n, M) described in (I2bp and fl2cl) 
of Theorem 16. II are exactly the ones that belong to the Teichmiiller components defined 
by Hitchin [26] . 

It remains to deal with the special cases Sp(4,]R) and SOo(2,3) (cf. Sec. 13.31) . 

Theorem 6.5. Let G be one of the groups Sp(4, M) or S0o(2, 3) and let {E,ip = P + 'j) 
be a polystable G-Higgs bundle with positive Toledo invariant. Then {E, ip) represents a 
local minimum of f if and only if one of the following situations occurs: 

(1) The vanishing (3 = holds. 

(2) If G = SOo(2,3) and the associated Higgs vector bundle is {V © W,^), then 
there are decompositions in line bundles 

V = K®K-^ and W = M ® O ® M-\ 

with < deg(M) ^ Ag — A. With respect to these decompositions, 

Qv = (10) and = (^0 10) , 

7 is the canonical section 1 of }lom{0 , K~^) ® K = O while (3 is a non-zero 
section of Hom(M, K) K, i.e. 

(3 e h\m~^k'^). 

In this case, necessarily the Toledo invariant is maximal, i.e., d = 2g — 2. 

(3) IfG = Sp(4,]R) and the associated Higgs vector bundle is {VQ)V*, $), then there 
is a decomposition in line bundles 

V = N® N-^K, 
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with g—1 < deg(A^) ^ 3(?— 3. With respect to this decomposition, 7 G H^{S'^V*® 
K) is given by the tautological section 



and P G H^{S'^V ^ K) is a non-vanishing section of the form 



Also in this case, necessarily the Toledo invariant is maximal, i.e., d = 2g — 2. 

Remark 6.6. Following through the correspondence between Sp(4, ]R)-Higgs bundles and 
S0o(2, 3)-Higgs bundles described in Sec. 13.31 one sees that a minimum for Sp(4, M) of 
the type given in ([3]) of Theorem 16.51 gives rise to a minimum of the type given in ([2]) 
of the theorem with M = N'^K~^. Thus, in particular, deg(M) is even and, in fact, 
one can see that the second Stiefel- Whitney class W2{W,Qw) is exactly the modulo 2 
reduction of the degree of M, thus confirming (in the case of these minima) that this is 
the obstruction to lifting to Sp(4, R). 

Remark 6.7. In the case G = SOo(2,3), the Cayley correspondence of Theorem 14.51 
becomes particularly simple to describe for the S0o(2, 3)-Higgs bundles which are local 
minima (of maximal Toledo invariant, of course): the kernel of 7 is F = M © 
(cf. (14.31) ) and the restriction of Qw to F is clearly non-degenerate. Furthermore, 
Lo = L-^K = K-^K is trivial, 6" = and 9' : F ^ is given hj p e H^{M-^K^) = 
ifO(Hom(M, K^)). 

Remark 6.8. The minima for SOo(2,3) which belong to a Teichmiiller component are 
of the type described in ([2]) of Theorem 16.51 with deg(M) = 4g — 4. Note that, since 
/? 7^ 0, this forces M = K~^. Thus there is a unique such minimum and this lifts to a 
minimum for Sp(4,]R) because deg(M) is even (cf. Remark 16. 6p . 

The minima for Sp(2?2, R) which belong to a Teichmiiller component are of the type 
described in ^ of the Theorem with deg(A^) =3(7 — 3. Note that, since /? 7^ 0, this 
means that N = 7^3/2 _ Hence we see that there are 2^^ such minima, corresponding to 
the choices of the square root of the canonical bundle K. Clearly each of these minima 
are lifts of the unique minimum for S0o(2, 3). 

6.2. The counting of components. In this section we give the count of the number 
of components of A^max(G). Using Theorems 14.71 and 14. 8^ we can reduce the problem 
to the case where G/H is of tube type, i.e., when G is one of the groups SU(n, ra), 
Sp(2r;,,R), S0(2,n) or S0*(2n) with n even. The number of connected components of 
-A^max(G') is given in Table [21 

The general strategy for counting the components of A^max(G') when G/H is of tube 
type is as follows: 

(1) Use the Cayley correspondence of Theorem 14.51 to obtain extra topological in- 
variants, via the identification of 7Mmax(G) with the moduli space of K^-twisted 
G"-Higgs pairs. The relevant topological invariants can be read off Table H] as 
those of bundles whose structure group is the maximal compact H' C G'. This 
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provides a subdivision 

MmUG) = MK^iG') = [jMK^ciG'), 

c 

according to the values of these topological invariants. 

(2) Use the results of Sec. 16.11 to identify the local minima of / on each of the 
subspaces A^i^2 ^(G') defined in ([1]). 

(3) For each subspace Aix'^^dG'), determine whether the space of local minima is 
connected and non-empty: if this is the case, then Aix^^dG') is a connected 
component of A^max- 

(4) When the subspace of local minima of / on AiK^,c{G') is not connected, find 
its connected components. It turns out that this only happens due to the pres- 
ence of one or more Teichmiiller components — in this case, non-Teichmiiller 
components with the same invariants may or may not exist. 

In the following we outline how this strategy is carried out for each of the groups 
mentioned above. 

• G = SU(n,n): 

Consulting Table H] we see that the relevant topological invariants are those of H' = 
S\J{n) X Z2-bundles. Since ttq{H') = Z2 and 7Ti{H') = {!}, it follows that the invari- 
ant takes values in H^{X;7j2) = ^2 ■ '^^^ corresponding minima are given by ([T]) of 
Theorem 16.11 as having /? = 0. In terms of the Cayley correspondence (14.21) this means 
that the pair (VT, G) has 6' = 0. Hence the subspace of local minima is isomorphic to 
the moduli spac^ of vector bundles W such that (det = O. This moduli space 
has a connected component for each of the 2^^ choices of square root of the trivial line 
bundle and it is not difficult to see that this choice corresponds exactly to the value of 
the topological invariant in H^{X; Z2) = Zg^. This gives a total of 2^^ connected com- 
ponents of A^max(G'), as stated in Table [21 It is interesting to notice that this analysis is 
also vahd for the case SU(1, 1) = Sp(2,]R); however it is somewhat special, in that each 
of the 2^^ components is a Teichmiiller component (in fact isomorphic to Teichmiiller 
space). This is obviously not the case when n 1. 

• G = Sp(2n,M): 

In this case Table H] shows that the relevant group is G' = GL(n, M). Thus the 
invariants are the first and second Stiefel-Whitney classes Wi G H^{X;7j2) — ^2 ^^"^ 
W2 e li'^{X\ Z2) = Z2. For each of the possible values of (wi, W2) there are minima of the 
type given in (!2al) of Theorem 16.11 i.e., with /5 = 0. Under the Cayley correspondence 
(14.11) these correspond to pairs {W^ 6) with 6 = (cf. Sec. 14. 2p where W is an orthogonal 
bundle. Thus, for given (^1,^2), the space of minima of this type can be identified 
with the moduli space of 0(n, C)-bundles with these invariants. The moduli space 
of principal bundles for a connected group and fixed topological type is known to be 
connected by Ramanathan [33i Proposition 4.2]. Now, since 0(n, C) is not connected 
the result of Ramanathan cannot be applied directly, however, all that is really required 



Here, and in the following, one must check that the various stability conditions involved in defining 
the moduli spaces agree. This is rather technical and we shall ignore this question in the present paper. 
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for his argument is that semistabihty is an open condition and thus one obtains the 
desired result (cf. [32] )• Hence there are 2 ■ 2^^ = 2^^"''^ connected components of 
A1max(Sp(2n, M)) corresponding to minima with /5 = 0. 

The case n ^ 3. In this case there are additional minima of the type described in 
(l2bl) and (!2c|) of Theorem 16.11 Each of these minima are easily seen to be the unique 
minimum of / on a Teichmiiller component (it can be seen that they all have W2 = 0, 
whereas Wi = when n is even and arbitrary for n odd). Since there is such a minimum 
for each square root of the canonical bundle, there are 2^^ Teichmiiller components. 
Hence the total number of components is 3 ■ 2^^. 

The case n = 2. Here G' = GL(2,]R) and the maximal compact subgroup is H' = 
0(2). One easily sees that the minima with (3^0, described in ([3]) of Theorem 16.51 
all have Wi = 0. Excluding the case Wi = we thus have (2^^ — 1) ■ 2 = 2^^+^ — 2 
possible values for the invariants, giving rise to the same number of components (the 
subspaces of minima are connected, as above). When the first Stiefel- Whitney class 
vanishes, there is a reduction of structure group to SO (2) = and then the second 
Stiefel-Whitney class W2 lifts to an integer invariant, namely the first Chern class ci 
of the S^-bundle. For the case of the minima with jS = 0, we have ci = and again 
the space is connected. Hence, corresponding to minima with (3 = 0, there are in total 
229+1 _ I components. For the minima with (3^0 described in ([3]) of Theorem 16.51 the 
value is Ci = deg(A^) — ((7 — 1). It follows from the bound g — 1 < deg(A^) ^ 3g — 3 that 
the corresponding subspace is non-empty only for Ci ^ 2g — 2. For each ci satisfying 
< Ci < 2(7 — 2 it can be proved that the subspace of minima is connected, thus 
showing that there is a unique (non- Teichmiiller, in fact) component for this value. 
When ci = 2g — 2 the minima belong to a Teichmiiller component and there are 
of these (again depending on the choice of a square root of the canonical bundle). The 
total number of components is thus 2^9+1 _ 1 + (251 - 3) + 2^9 = 3 ■ 2^9 + 251 - 4. 

The case n = 1. Since Sp(2, M) = SU(1, 1) this case has been treated above but, it can 
of course also be seen directly that A^rnax(Sp(2, M)) has 2^^ Teichmiiller-components. 

• G = S0o(2,n): 

The case n ^ 4. In this case the group giving rise to the extra invariants is H' = 
0(n — 1). Thus the new invariants are again Stiefel-Whitney classes Wi and W2- From 
([T]) of Theorem 16.11 we know that the only minima are the ones with /5 = so, exactly 
as explained for Sp(2?7,, M) above, the subspace of minima with given (iyi,iy2) can be 
identified with the moduli space of 0{n — 1, C)-bundles, which is connected. This gives 
the total of 2 • 2^9 = 2^9+1 components of Mm^^{G). 

The case n = 3. Here we have G' = S0(1, 1) x S0(l,2) with maximal compact 
subgroup H' = 0(2) and the analysis is parallel to the one given above for G = Sp(4, M). 
The invariants are {wi,W2) and all minima with wi 7^= have (3 = 0. When wi = 0, 
the class W2 lifts to an integer class ci and for ci = there is one component whose 
minima have (3 = 0. The remaining components have minima with (3 ^ oi the type 
described in ([2]) of Theorem 16.51 and the invariant is ci = deg(M). For each allowed 
value < deg(M) ^ 4g — 4 there is one connected component (which lifts to Sp(4, R) 
when deg(M) is even). The Teichmiiller component occurs for deg(M) = 4g — 4; in this 
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case there is just one, which is covered by the 2^^ projectively equivalent components 
for Sp(4, R). Thus the total number of components is 2^^"*"^ — l + 4g — 4 = 2^^"*"^ + 4(^ — 5 

Remark 6.9. The maximal compact subgroup of S0o(2,n) is H = S0(2) x SO(n). 
Hence vri(if) = Z © Z2 if n ^ 3. There is thus a second invariant attached to an 
S0o(2, n)-Higgs bundle (an element in Z2) in addition to the Toledo invariant. This can 
be identified as the second Stiefel-Whitney class of the SO(n, C)-bundle {W,Qw) in 
Table [31 We could have used this invariant to distinguish two disjoint closed subspaces 
in A1max(SOo(2, n)), but this is taken into account by the Cayley correspondence. 

The case n = l. In this case G = S0o(2, 1) = PSL(2,M) = PSp(2,M) and there is a 
unique minimum with (3 = 0. This belongs to the unique Teichmiiller component and 
lifts to the 2^^ projectively equivalent Teichmiiller components for G = SL(2,]R). 

m G = S0*(2n), with n = 2m: 

In this case Theorem 16.11 shows that all minima have (3 = and so from the Cayley 
correspondence (cf. Sec. 14. 2p we deduce that the subspace of minima on A^max(G') can 
be identified with the moduli space of principal if"^-bundles. Since H' is the simply 
connected group Sp(n) (see Table S]), it follows from Ramanathan [3^ that the space 
of minima is connected, thus showing that Aimn^iG) is also connected. 

We now study the case when G/H is not of tube type. 

• G = SU(p, q) with p ^ q: 

Without loss of generality we assume that p < q. From Theorem 14.71 we see that 
■Mraa^iG) is isomorphic to the moduli space A^' of G-Higgs bundles of the form (14.41) 
with deg{V) = p{g — 1) and 

det{V) (g) det{W') ® {W") ^ O, 

which means, as already noted, that every maximal SU(p, g)-Higgs bundle reduces to 
an S(U(p, p) X U(g — j9))-IIiggs bundle. 

Define a map from Ai' to the Jacobian parameterizing line bundles of degree p{g — 1) 

by 

M' Jf(^-^)(X) 
{V,W',W",(3,-f) ^ det{V) 
The fibre of this map over a line bundle L is a product of the moduli space 

ML-2K.{GL{q-p,C)) 

of polystable bundles W" of rank q — p and fixed determinant L^^K^ and the moduli 
space 

M = {{V,W\(3,^) : det{V) = L} 

which is a subspace of the moduh space J\4l2x-p(JJ{p,p)) of (maximal) U(p,p)-Higgs 
bundles with fixed determinant L'^K~^. Clearly M.l'^k-p{^{PiP)) is isomorphic to the 
moduli space A1max(SU(p, p)) and, similarly to this case, M.L2x-p{\]{p^p)) has 2^^ con- 
nected components, indexed by the square roots of L'^K~p. Fixing det(V") obviously 
amounts to fixing one of these square roots and hence is just one of these connected 
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components. The map to the Jacobian defined above is surjective since, if we are given 
another fine bundle L ® Lq, the map 

{V, W\ W\ /5, 7) ^ ® L]!'. W ® Ll^^, W" ® L~'^^'''\P, 7) 
gives an isomorphism between the fibre over L and the fibre over L ® Lq. Hence, the 
connectedness of the Jacobian, of Mx,-2/<-p(GL(g — p, C)) and of M. imply that A^' is 
connected and, consequently, A^maxlC) is connected. 

• G = S0*(2n), with n = 2m + 1: 

From Theorem 14.81 and the fact that the Jacobian J{X) is connected, we have that 
A^(S0*(4m + 2)) is connected since, as we have seen, A^(S0*(4m)) is connected. 
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7. Tables 



G 


H 




m"' = m+ + m_ 


SU(p,g) 


S(U(p) X U(g)) 


S(GL(p, C) X GL(g,C)) 


Hom(0, CP) + Hom(CP, C?) 


Sp(2n,M) 


U(n) 


GL(n, C) 




S0*(2n) 


U(n) 


GL(n, C) 


A2(c") + A2(C"*) 


S0o(2,n) 


S0(2) X SOH 


S0(2,C) X S0(r2, C) 


Hom(C", C) + Hom(C, C") 



Table 1. Irreducible classical Hermitian symmetric spaces G/H 



G 


#vro(A^max(G')) 


Teichmiiller 
components 


Reference 


SU(n, n) 




(2^3 if n ^ 1) 




SU(p, q) {p ^ q) 


1 




[11111115] 


Sp(2n,M) (n^3) 




229 


[1H3 


S0o(2,n) (n^4) 


229+1 







S0*(2n) 


1 




[5] 


Sp(4,M) = Spino(2,3) 


3-229 + 2^-4 


225 


[22J 


SOo(2,3) 


225+1 + 4^-5 


1 





Sp(2,M) ^ SL(2,M) 


225 


225 


[211 [25J 


S0o(2,l) = PSL(2,M) 


1 


1 


[SUES] 



Table 2. Components of Almax(G') 



G 


SU(p,g) 


Sp(2n,M) 


S0*(2n) 


S0o(2,n) 


</? = /3 + 7 


y: rank p bundle 
W: rank bundle 

det V ®deiW = 

f3 e iJ°(Hom(py,\/) ® is:) 

7 e ii'°(Hom(V,W^) (g)is:) 


y: rank n bundle 

f3 e H^{S^V ® K) 
7 e H^{S'^V* ® K) 


y: rank n bundle 

G iJ°(A2\/ ® K) 
7 e ii'°(A2\/* (g) K) 


{V^L®L-\Qv^{\l)) 
[W, Qw)'- rank n 

\ 7 yy/ 

orthogonal bundle 
L: line bundle; det W = O 
(3 G i/°(Hom(PV,L) ®i^) 
7 G ii'°(Hom(W^,L-i) (8)is:) 


C SL(Ar, C) 
E = E{C^) 
$ e //°(EndE® /sT) 


^ = 


E = y e 
^=(;^) 


E = y e 


E = T/eiy 

/ /3\ 
$ = 7 

V -7* J 


Toledo invariant 


d = deg V — — deg 1^ 


d = degy 


d = degy 


d — deg L 


Milnor-Wood 
inequality 


\d\ ^ min{p, - 1) 


\d\^n{g-l) 


MK [11(25-2) 


\d\^2g-2 



Table 3. Higgs bundles for irreducible classical symmetric spaces G/H 



G 


H 


G" 




5 = 


m' 




SU(n,n) 


S(U(n) X U(n)) 


{AeGL(n,C) : 

det{Af = 1} 
= SL(n, C) X Z2 


{AeV{n) : 

dct(A)2 = 1} 
^ SU(n) X Z2 


U(n) 


Herm(n, C) 


Mat(n, C) 


Sp(2n,M) 


U(n) 


GL(n,M) 


0(n) 


U(n)/0(n) 


Sym(n, M) 


Sym(n, C) 


S0*(2n) ,n = 2m 


U(n) 


U*(n) 


Sp(n) 


U(n)/Sp(n) 


Herm(m, H) 


Skew(n, C) 


S0o(2,n) 


S0(2) X SO(n) 


SOo(l,l) X SO(l,n- 1) 


O(n-l) 


U(l) X S""-^ 
Z2 


R X R"-i 


C X C"-i 



Table 4. Irreducible classical tube type Hermitian symmetric spaces G/H 



G 


H 




G 


H 


H' 


iJ" = H'/H' 


SU(p,g) ,p<q 


S(U(p) X U(g)) 


{(A5)eU(p)xU(g-p): 
det(A)2dct(fi) = 1} 
^S(U(p)xU(g~p)) XZ2 


SU(p,p) 


S(U(p) X U(p)) 


SU(p) X Z2 


S(U(l)xU(g-p)) 


SO*(4m + 2) 


U(2m + 1) 


Sp(2m) X U(l) 


SO* (4m) 


U(2m) 


Sp(2m) 


U(l) 



Table 5. Irreducible classical non-tube type Hermitian symmetric spaces G/H 
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